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Abstract — In this paper we derive analytical expressions for 
the central and side quantizers which, under high-resolutions 
assumptions, minimize the expected distortion of a symmetric 
multiple-description lattice vector quantization (MD-LVQ) sys- 
tem subject to entropy constraints on the side descriptions for 
given packet-loss probabilities. 

We consider a special case of the general n-channel symmetric 
multiple-description problem where only a single parameter 
controls the redundancy tradeoffs between the central and the 
side distortions. Previous work on two-channel MD-LVQ showed 
that the distortions of the side quantizers can be expressed 
through the normalized second moment of a sphere. We show 
here that this is also the case for three-channel MD-LVQ. 
Furthermore, we conjecture that this is true for the general n- 
channel MD-LVQ. 

For given source, target rate and packet-loss probabilities we 
find the optimal number of descriptions and construct the MD- 
LVQ system that minimizes the expected distortion. We verify 
theoretical expressions by numerical simulations and show in a 
practical setup that significant performance improvements can 
be achieved over state-of-the-art two-channel MD-LVQ by using 
three-channel MD-LVQ. 

Index Terms — high-rate quantization, lattice quantization, 
multiple description coding, vector quantization. 



I. Introduction 

MULTIPLE description coding (MDC) aims at creating 
separate descriptions individually capable of reproduc- 
ing a source to a specified accuracy and when combined being 
able to refine each other The classical scheme involves two 
descriptions, see Fig. Q The total rate R is split between the 
two descriptions, i.e. R = Rq+Ri, and the distortion observed 
at the receiver depends on which descriptions arrive. If both 
descriptions are received, the distortion (dc) is lower than if 
only a single description is received (do or di). 

Existing MDC schemes can roughly be divided into 
three categories: quantizer-based, transform-based and source- 
channel erasure codes based. Quantizer-based schemes include 
scalar quantization [l]-[4], trellis coded quantization [5]-[7] 
and vector quantization [8]-[16]. Transform-based approaches 
include correlating transforms [17]-[19] and overcomplete 
expansions [20]-[22]. Recently, schemes based on source- 
channel erasure codes have been introduced [23]-[26]. For 
further details on many existing MDC techniques we refer to 
the survey article by Goyal [27]. The present work is based 

This work was presented in part at tlie IEEE Data Compression Conference, 
Snowbird, Utah, 2005. This research is supported by the Technology Founda- 
tion STW, applied science division of NWO and the technology programme 
of the ministry of Economics Affairs. The authors are with the Department 
of Information and Communication Theory, Delft University of Technology, 
2628 CD Delft, The Netherlands. 
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Fig. 1. The traditional two channel MDC scheme. 



on lattice vector quantization and belongs therefore to the first 
of the categories mentioned above. 

The achievable rate-distortion (R-D) region for the two- 
channel problem with respect to the Gaussian source and 
mean-square error fidelity criterion has been known for at least 
two decades [28], [29]. The procedures leading to the achiev- 
able region were however non-constructive, and the puzzle 
of designing a system capable of achieving the performance 
promised by theory remained unsolved. In 1993 Vaishampayan 
designed a practical MDC scheme for the scalar case [1]. The 
idea was to quantize the source by a central quantizer and then 
apply an index-assignment algorithm that uniquely mapped all 
reconstruction points of the central quantizer to reconstruction 
points in two side quantizers, thereby obtaining two coarser 
descriptions of the source. If both descriptions were received, 
the inverse map was applied and the performance of the central 
quantizer was achieved, whereas if only one of the descriptions 
was received the source was reproduced at the resolution of 
one of the side quantizers. The scheme developed in [1] was, 
however, 8.29 dB from the lower bound on the MDC distortion 
product for Gaussian sources [30], [31]. Later, Vaishampayan 
et al. described an entropy-constrained multiple-description 
scalar quantization system [2] that, under high-resolution 
assumptions, is 2.67 dB from the lower bound [30], [31]. 

Recently, practical schemes for two descriptions have been 
introduced [11]-[14], that in the limit of infinite-dimensional 
source vectors approach the lower bound. Similar to [1], [2], 
these schemes exploit the idea of having only one central 
quantizer followed by an index-assignment algorithm that 
maps each central quantizer reconstruction point to pairs 
of side quantizer reconstruction points. The quantizers used 
in [11]-[14] are all lattice vector quantizers. It is common 
to distinguish between symmetric and asymmetric MDC. In 
the symmetric case the entropies of the side descriptions are 
equal and the distortions of the side descriptions are also 
equal whereas in the asymmetric case entropies and distortions 
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are allowed to be unequal. Multiple-description lattice vector 
quantization (MD-LVQ) for the symmetric case was first 
considered in [11], [13] where for given target entropies of 
the side descriptions {Ro,Ri = Rq) as well as maximum 
allowable distortions (do, di = do) of the side descriptions the 
central distortion dc is minimized. It is shown that exploiting 
the structure in lattices makes it possible to consider only 
a limited region of the lattices, which makes the solution 
computationally feasible without sacrificing optimality. A key 
observation in [11], [13] is that the side distortions depend on 
the scaling of the lattices but are independent of the specific 
types of lattices. In fact the side distortions can be expressed 
through the normalized second moment of a sphere. 

Asymmetric MD-LVQ is presented in [12], [14] where the 
central distortion dc is minimized for given target entropies 
{Rq, Ri) and maximum allowable side distortions {do, di). A 
property of all the schemes presented in [11]-[14] is that a 
simple scaling of the lattices allows adaptation to changes in 
target entropies without the need of any iterative training pro- 
cedures. In [32], [33] it is observed that the scheme developed 
in [13] is not able to continuously trade off central distortion 
versus side distortions. However, using non-lattices obtained 
by slightly modifying the lattices in [13] in an iterative fashion 
that alternates between optimizing the encoder while keeping 
the decoder fixed and optimizing the decoder while keeping 
the encoder fixed, it is possible to obtain a continuous range 
of redundancies. The problem of achieving a continuous range 
of redundancies is treated in more detail in [15]. 

The schemes mentioned above all consider two descrip- 
tions and the extension to more than two descriptions is not 
straightforward. State-of-the-art schemes for more than two 
descriptions are based on source-channel erasure codes [23]- 
[26] which are fundamentally different from the quantizer- 
based approaches considered above. Schemes based on source- 
channel erasure codes rely upon the assumption that at least 
K out of K descriptions are received, for some pre-specified 
K. If less than k descriptions are received, the quality of the 
reconstructed source is poor and if k or more descriptions 
are received a good quality can be achieved. Among the few 
quantizer-based approaches which consider more than two 
descriptions are [3], [4], [8]-[10], [16]. 

In this paper' we consider a special case of the general n- 
channel symmetric multiple-description problem where only a 
single^ parameter controls the redundancy tradeoffs between 
the central and the side distortions. With a single controling 
parameter it is possible to describe the entire symmetric R-D 
region for two descriptions as shown in [11], [13] but it is not 
enough to describe the symmetric achievable n-channel R-D 
region. As such the proposed scheme offer a partial solution 
to the problem of designing balanced MD-LVQ systems. 

We derive analytical expressions for the central and side 
quantizers which, under high-resolutions assumptions, mini- 
mize the expected distortion at the receiving side subject to 
entropy constraints on the side descriptions for given packet- 

'A conference version of this work appeared in [16]. 

^We sliow in [34] that additional control pai'ameters can be included in 
the MD-LVQ scheme presented in this paper by exploiting recent results on 
distributed source coding [23]. 



loss probabilities. The central and side quantizers we use are 
lattice vector quantizers as presented in [13], [14]. The central 
distortion, in our scheme, depends upon the lattice in question 
whereas the side distortions only depend on the scaling of the 
lattices but are independent of the specific types of lattices. In 
the case of three descriptions we show that the side distortions 
can be expressed through the normalized second moment of 
a sphere as was the case for the two descriptions system 
presented in [11], [13]. Furthermore, we conjecture that this is 
true in the general case of an arbitrary number of descriptions. 

While state-of-the-art quantizer-based MDC schemes [13], 
[14] mainly deal with only two descriptions, we construct 
balanced quantizers for an arbitrary number of descriptions. 
In the presented approach the expected distortion observed at 
the receiving side depends only upon the number of received 
descriptions, hence the descriptions are mutually refinable and 
reception of any k out of K descriptions yields equivalent 
expected distortion. This is different from successive refine- 
ment schemes [35] where the individual descriptions often 
must be received in a prescribed order to be able to refine 
each other, i.e. description number / will not do any good 
unless descriptions 0, . . . , Z — 1 have akeady been received. We 
construct a scheme which for given packet-loss probabilities 
and a maximum bit budget (target entropy) determines the 
optimal number of descriptions and specifies the quantizers 
that minimize the expected distortion. 

This paper is structured as follows. In Section |II| we briefly 
review specific lattice properties and introduce the concept of 
an index-assignment algorithm. The actual design of the index- 
assignment algorithm is deferred to Section |llll Reconstruc- 
tion of the source and optimal construction of the labeling 
function is also presented in Section Ull] In Section IIVI we 
present a high-resolution analysis of the expected distortion. 
We describe how to construct the quantizers in Section [V] 
and numerical evaluation follows in Section IVII Appendices 
contain proofs of Theorems. 

II. Preliminaries 

In this work we use lattices as vector quantizers. For a 
general treatment of quantizers based on lattices, see [36]- 
[38]. This section briefly review lattice properties, introduces 
the concept of index assignments and describe important 
results regarding rate and distortion performance of MD-LVQ 
systems. 

A. Lattice Properties 

A real L-dimensional lattice A is a discrete set of points in 
the L-dimensional Euclidean space M^. It forms an additive 
group under ordinary vector addition and can be specified 
through L independent basis vectors [39]. The lattice then 
consists of all possible integral linear combinations of the basis 
vectors, or, more formally 

A = |a e M-^ : A = e z| , (1) 

where bi are the basis vectors also known as generator vectors 
of the lattice. 
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When A is used as a vector quantizer, a point (vector) 
X e is mapped to the closest lattice point A € A. The 
lattice points are then the codewords (reproduction points) of 
the quantizer. This quantization process partitions the space 
into cells called Voronoi cells, Voronoi regions or nearest- 
neighbor decision regions. The Voronoi cells of a lattice are 
congruent polytopes^, hence they are similar in size and shape 
and may be seen as translated versions of a fundamental 
region, e.g. the Voronoi cell around origo. A Voronoi cell, 
V{\), where A e A, is given by 

V{\) = {x e : ||a; - A||^ < \\x - A'||^ V A' e A}, (2) 

and we write Q{x) = A if a; e V{X). Throughout this work 
we will be considering the ^2-norm (normalized per dimension) 
given by ||a;|p = {x, x), where the irmer product is defined as 

1 ^"^ 

{x,y) = j^^XiVi. (3) 

A lattice is completely specified by its fundamental region, 
and often expressed through the volume v of the fundamental 
region as well as its dimensionless normalized second moment 
of inertia G(A) [37], which is given by 

G(A) = tAji I M'dx, (4) 

where V{Q) is the Voronoi cell around origo. Applying any 
scaling or orthogonal transform, e.g. rotation or reflection on 
A will not change G(A), which makes it a good figure of 
merit when comparing different lattices (quantizers). In other 
words, G(A) depends only upon the shape of the fundamental 
region, and in general, the more sphere-like shape, the lower 
normalized second moment. 

In this paper we consider one central quantizer and K side 
quantizers. The central quantizer is based on a central lattice 
Ac C with fundamental regions of volume v = det(Ac). 
The side quantizers are based on a geometrical similar"* 
sublattice A^ C Ac of index N =[Kc : A^] and fundamental 
regions of volume Vs = vN . The trivial case K = 1 leads to 
a single-description system, where we would simply use one 
central quantizer and no side quantizers. 

We will consider the balanced situation, where the entropy 
Rs is the same for each description. Furthermore, we consider 
the case where the contribution di,i = 0, K — 1 of each 
description to the total distortion is the same. Our design 
makes sure^ that the distortion observed at the receiving side, 
depends only on the number of descriptions received, hence 
reception of any k out of K descriptions yields equivalent 
expected distortion. 

'a polytope is a finite convex region enclosed by a finite number of 
hyperplanes [40]. 

''A lattice As is said to be geometrical similar to Ac if A^ can be obtained 
from Ac by applying a change of scale, a rotation and possible a reflection 
[37]. 

'We prove this symmetry property for the asymptotical case of AT — »■ oo 
and Us — ► 0. For finite N we do not guarantee the existence of an exact 
symmetric solution. However, by use of time-sharing, it is always possible to 
achieve symmetry. 



B. Index Assignments 

In the MDC scheme considered in this paper, a source 
vector X is quantized to the nearest reconstruction point Ac 
in the central lattice Ac. Hereafter follows index assignments 
(mappings), which uniquely maps all Ac's to vectors in each of 
the side quantizers. This mapping is done through a labeling 
function a, and we denote the individual component functions 
of a by ai, where i = 0, . . . , K — 1. In other words, the 
injective map a that maps Ac into As x • • • x As, is given by 

a(Ac) = (ao(Ac), ai(Ac), . . . , aif _i(Ac)) (5) 
= (Ao, Ai, . . . , Aif_i), (6) 

where ai{Xc) = A^ G Ag and i = 0, . . . ,K — 1. Each iC-tuple 
(Ao, . . . , Xk-i) is used only once when labeling points in Ac 
in order to make sure that Ac can be recovered unambiguously 
when all K descriptions are received. At this point we also 
define the inverse component map, Q^^, which gives a set of 
central lattice points a specific sublattice point is mapped to. 
This is given by 

a7^{>^^) = {Ac e Ac : a^(Ac) = AJ for all A, e As, (7) 

where \a-^{Xi)\ « N, since there are N times as many central 
lattice points as sublattice points within a bounded region of 

Since lattices are infinite arrays of points, we construct a 
shift invariant labeling function, so we only need to label a 
finite number of points as is done in [13], [14]. Following the 
approach in [14] we construct a product lattice A^r which has 
N'^ central lattice points and N sublattice points in each of 
its Voronoi cells. The Voronoi cells of the product lattice 
A^ are all similar so by concentrating on labehng only central 
lattice points within one Voronoi cell of the product lattice, 
the rest of the central lattice points may be labeled simply by 
translating this Voronoi cell throughout M^. Other choices of 
product lattices are possible, but this choice has a particular 
simple construction. With this choice of product lattice, we 
only label central lattice points within K-(O), which is the 
Voronoi cell of A^ around origo. With this we get 

a{Xc + Xn) = a{Xc) + X^, (8) 

for all A,r € and all Ac S Ac. 

C. Rate and Distortion Performance of MD-LVQ Systems 

1) Central Distortion: We consider a source that gener- 
ates independent identically distributed random variables with 
probabihty density function (pdf) /. Let X G be a random 
vector made by blocking the source into vectors of length L, 
and let a; e denote a realization of X. The L-fold pdf of 
X is denoted fx and given by 

L-l 

fx{x) = n fi^j)- (9) 

The expected central distortion dc is defined as 

dc= I \\x-X,ffx{x)dx, (10) 
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where Vc{Xc) is the Voronoi cell of a single reconstruction 
point Ac e Ac. Using standard high-resolution assumptions 
for lattice quantizers [36], [38], [41], the expected central 
distortion can be expressed in terms of the dimensionless 
normalized second moment of inertia, G(Ac), that is 



G(Ac)^^2/^ 



(11) 



where G(Ac) is given by @. 

2) Side Distortions: The side distortion for the ith descrip- 
tion is given by 



= / \\x-ai{Xc)\\'^fx{x)dx, i = 0, 

which can be approximated as [13] 

«dc+ ||Ac-a.(Ac)fF(Ac), 



,K-1, 
(12) 

(13) 



where P{Xc) is the probability that X will be mapped to 
Ac, i.e. P{Q{X) ~ Ac) = Jv {\ )fx{x)dx. We notice that 
independent of which labeling function we use, the distortion 
introduced by the central quantizer is orthogonal (under high- 
resolution assumptions) to the distortion introduced by the 
side quantizers. Exploiting the shift-invariance property of the 
labeling function (|8} makes it possible to simplify (I13> as 



dc+ ^ 



1 



N2 

Aoey„(o) 



||Ac - a,(Ac)|| 



= dc + jp 2. 

Ac6VV(0) 



||Ac-a,(Ac)|P, i = 0,. 



(14) 



where we assume the region VTr{Q) is sufficiently small so 
P(Ac) ~ P{Xt,)/N'^, for Ac e V7r(A7r). Notice that we assume 
P{Xt^) to be constant only within each region Vt^{Xt^), hence 
it may take on different values for each A^ e A^r. 
3} Rate: 

Definition 2.1 : Rc = H{Q{X))/L denotes the minimum 
entropy needed for a single-description system to achieve an 
expected distortion of dc, the central distortion of the multiple- 
description system as given by (II 1> . 

The single-description rate Rc is given by 




fx{x)dx 



i?c = -y V / fx{x)dx log 

(15) 

Using that each quantizer cell has identical volume i/ and 
assuming that fx{x) is approximately constant within Voronoi 
cells of the central lattice Ac, it can be shown that 



Rc^h{X)-^log,{,y) 



(16) 



where h{X) is the component-wise differential entropy of a 
source vector. 

Definition 2.2: Rg denotes the entropy of the individ- 
ual descriptions in a balanced multiple-description system. 
The entropy of the ith description is given by Rg — 
H{a.,{Q{X)))/L, where i = 0, . . . , if - 1. 



The side descriptions are based on a coarser lattice obtained 
by scaling the Voronoi cells of the central lattice by a factor 
of N . Assuming the pdf of X is roughly constant within a 
sublattice cell, the entropy of the side descriptions is given by 



Rs^h{X)-^\og^{Ny). 



(17) 



The entropy of the side descriptions is related to the entropy 
of the single-description system by 



Rs^Rc-\\og^{N). 



III. Construction of Labeling Function 



(18) 



The index assignment is done by a labeling function a, that 
maps central lattice points to sublattice points. An optimal 
index assignment minimizes a cost functional when < k < 
K descriptions are received. In addition, the index assignment 
should be invertible so the central quantizer can be used 
when all descriptions are received. Before defining the labeling 
function we have to define the cost functional to be minimized. 
To do so, we first describe how to approximate the source 
sequence when receiving only k descriptions and how to 
determine the expected distortion. Then we define the cost 
functional to be minimized by the labeling function a and 
describe how to minimize it. 



A. Expected Distortion 

At the receiving side, X e is reconstructed to a 
quality that is determined only by the number of received 
descriptions. If no descriptions are received we reconstruct 
using the expected value, and if all K descriptions 

are received we reconstruct using the inverse map a^^, hence 
obtaining the quality of the central quantizer 

In this work we use a simple reconstruction rule which 
applies for arbitrary sources. When receiving 1 < k < 
K descriptions we reconstruct using the average of the k 
descriptions. We show later (Theorem 13. 1> that using the 
average of received descriptions as reconstruction rule makes it 
possible to split the distortion due to reception of any number 
of descriptions into a sum of squared norms between pairs 
of lattice points. Moreover, this lead to the fact that the side 
quantizers performances approach that of quantizers having 
spherical Voronoi regions. 

There are in general several ways of receiving k out of 
K descriptions. Let C denote an index set consisting of all 
possible K combinations out of {0, . . . , if — 1}. Hence \C\ = 
(^)- denote an element of £ by Z = {Iq, . . . , l^-i} G C. 
Upon reception of any k descriptions we reconstruct to X 
using 



X 



K — 1 



(19) 



3=0 



where I e C. 

Assuming packet-loss probabilities are independent and are 
the same for all descriptions, say p, we may write the expected 
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distortion when receiving k out K descriptions as 



From Theorem 13. II it is clear that i22\ can be written as 



X I \^ ]dr 



E E 



iV2 



leC AeGVW(O) 



(20) 



where A;. — a;. (Ac) and the two special cases k E {0,K} 
are given by « and di'^''^'^ « (l-p)^4. 



B. Coif Functional 

From (I20> we see that the side distortion may be split into 
two terms, one describing the distortion occurring when the 
central quantizer is used on the source, and one that describes 
the distortion due to the index assignment. An optimal index 
assignment jointly minimizes the second term in over all 
1 < K < K ~ 1 possible descriptions. The cost functional J' 
to be minimized by the index assignment algorithm is then 
given by 



K-l 



(21) 



7V2 

JP Ik 




E 



K-K 



K^KiK - 1), 



K~2 K-l 



T) E E 11^- A, 



(23) 



where 



The first term in J23> describes the distance from a central 
lattice point to the centroid of its associated i^-tuple. The 
second term describes the sum of pairwise squared distances 
(SPSD) between elements of the JC-tuples. In Section IIVI 
(Proposition 14. 1> we show that, under a high-resolution as- 
sumption, the second term in ( I23> is dominant, from which 
we conclude that in order to minimize (12 1> we have to choose 
the ii'-tuples with the lowest SPSD. These iC-tuples are then 
assigned to central lattice points in such a way, that the first 
term in ( I23> is minimized. 

Independent of the packet-loss probability, we always min- 
imize the second term in (I23> by using those iC-tuples which 
have the smallest SPSD. This means that, at high resolution, 
the optimal if-tuples are independent of packet-loss probabili- 
ties and, consequently, the optimal assignment is independent^ 
of the packet-loss probability. 



j{K,k) ^ 



iV2 



E E 



Ac--E^'. 



(22) 

The cost functional should be minimized subject to an entropy 
constraint on the side descriptions. We remark here that the 
side entropies depend solely on ly and N and as such not on 
the particular choice of ii'-tuples. In other words, for fixed 
N and the index assignment problem is solved if (I21> is 
minimized. The problem of choosing v and N such that the 
entropy constraint is satisfied is independent of the assignment 
problem and deferred to Section IIV-BI 

The following theorem makes it possible to rewrite the cost 
functional in a way that brings more insight into which K- 
tuples to use. 

Theorem 3.1: For 1 < k < i^T we have 



EE 



^ K—1 

Ac--E^'. 



3=0 




K-K 



K^k{K - 1) 
Proof: See Appendix U 



4=0 

K-2 K-l 



n E E 11^-^. 



1=0 J=i+1 



□ 



C. Minimizing Cost Functional 

In order to make sure that a is shift-invariant, we use unique 
iiT-tuples, i.e. /^-tuples that are assigned to one central lattice 
point Ac G Ac only. Notice that two /v-tuples which are 
translates of each other by some A^r G A-^ must not both 
be assigned to central lattice points located within the same 
region ^/^^(ATr), since this causes assignment of the same K- 
tuples to multiple central lattice points. The region T4-(0) will 
be translated through-out and centered at A^ e A^r, so 
there will be no overlap between neighboring regions, i.e. 
F^(A^) n V^{X^) = 0, for A^,A^' e A^ and A^ ^ A^'. One 
obvious way of avoiding assigning A'-tuples to multiple central 
lattice points is then to exclusively use sublattice points located 
within V^(0). However, sublattice points located close to but 
outside VjriO), might be better candidates than sublattice points 
within VTr{0) when labeling central lattice points close to the 
boundary. A consistent way of constructing AT-tuples, is to 
center a region V at all sublattice points Ao G A^ n V7r(0), 
and construct AT-tuples by combining sublattice points A^ e 
As,i — 1, . . . , K — 1 within V^(Ao) in all possible ways and 
select the ones that minimize i23\ . For a fixed A^ G Aj, the 
expression X^a sA ny(A ) W^^i ^ '^ill^ minimized when V 
forms a sphere centered at A;. Our construction allows for V 
to have an arbitrary shape, e.g. the shape of Vtt which is the 

*Given the central lattice and the sublattice, the optimal assignment is 
independent of p. However, we show later that the optimal N depends on 
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shape used for the two-description system presented in [14]. 
However, if V is not chosen to be a sphere, the SPSD is in 
general not minimized. 

For each Aq £ As n Kr(0) it is possible to construct N^~^ 
if -tuples, where N is the number of sublattice points within 
the region V. This gives a total of NN^^^ if-tuples when all 
Ao e As n V^{0) are used. However, only central lattice 
points need to be labeled. When K = 2, we let N — N, so the 
number of possible /f -tuples is equal to N'^, which is exactly 
the number of central lattice points in K-(O). In general, for 
K > 2, the volume i> of is smaller than the volume of 
T/7r(0) and as such N < N. We can approximate N through the 
volumes i/g and D, i.e. N w i'/i^s- To justify this approximation 
let A C be a real lattice and let i/ ~ det(A) be the volume 
of a fundamental region. Let S{c, r) be a sphere in of 



radius r and center c G 



According to Gauss' counting 



principle, the number A-^ of integer lattice points in a convex 
body C in equals the volume Vol(C) of C with a small 
error term [42]. In fact if C = 5(c, r) then by use of a theorem 
due to Minkowski it can be shown that, for any c G and 
asymptotically as r — > oo, Aj^{r) = Vol(S'(c, r)) = cj^r^, 
where is the volume of the L-dimensional unit sphere [43], 
see also [44]-[48]. It is also known that the number of lattice 
points At^{n) in the first n shells of the lattice A satisfies, 
asymptotically as n ^ cx3, Af^{n) — lolti'^^'^/v [13]. Hence, 
based on the above we approximate the number of lattice 
points in V hy v/vg, which is an approximation that becomes 
exact as the number of shells n within V goes to infinity^ 
(which corresponds to — > oo). Our analysis is therefore 
only exact in the limiting case of A^ — > oo. With this we can, 
in the asymptotical case of oo, lower bound v by 



z>>z.siVi/(^-i). 



(24) 



Hence, V contains N > A^i/(^^i) sublattice points so that 
the total number of possible AT-tuples is NN^~^ > N^. 

In Fig. 121 is shown an example of V and t^- regions for the 
two-dimensional lattice. In the example we used K — 3 
and N = 25, hence there are 25 sublattice points within K-. 
There are TV = ]\f^/i^-'^) — 5 sublattice points in V which 
is exactly the minimum number of points required, according 
to (|24j. 

With equality in (I24> we obtain a region that contains the 
exact number of sublattice points required to construct N 
tuples for each of the N Ao points in 14- (0). According to i23\ . 
a central lattice point should be assigned that A'-tuple where 
a weighted average of any subset of the elements of the K- 
tuple is as close as possible to the central lattice point. The 
optimal assignment of AT-tuples to central lattice points can 
be formulated and solved as a linear assignment problem [49]. 

1) Shift-Invariance by use of Cosets: By centering V 
around each Aq G As n 1^(0), we make sure that the map 
a is shift-invariant. However, this also means that all K- 
tuples have their first coordinate (i.e. Aq) inside V^7r(0). To be 
optimal this restriction must be removed which is easily done 

'For the high-resolution analysis given in Section llVl it is important that u 
is kept small as the number of lattice points within V goes to infinity. This 
is easily done by proper scaling of the lattices, i.e. making sure that i/s — » 

as A'' ^ 00. 




Fig. 2. The region V is here shown centered at two different sublattice 
points within Vn-(O). Small dots represents sublattice points of As and large 
dots represents product lattice points A,r G A,r- Central lattice points are not 
shown here. V-n- contains 25 sublattice points (shown as squares) centered at 
product lattice points. In this example V contains 5 sublattice points. 



by considering all cosets of each AT-tuple. The coset of a fixed 
AT-tuple, say t — (Aq, Ai, . . . , A_r-^i) where Aq G As n V^(0) 
and (Ai, . . . , Aa'_i) G (As x • • • x As), is given by Coset(t) = 
{t + Ajr} for all Att G A^^. A'-tuples in a coset are distinct 
modulo Att and by making sure that only one member from 
each coset is used, the shift-invariance property is preserved. In 
general it is optimal to consider only those A^r product lattice 
points that are close to y,r(0), e.g. those points whose Voronoi 
cell touches VTr{0). The number of such points is given by the 
kissing-number AiA^^) of the particular lattice [37]. 

2) Dimensionless Expansion Factor tp^: Centering V 
around Aq points causes a certain asymmetry in the pairwise 
distances of the elements within a AT-tuple. Since the region is 
centered around Aq the maximum pairwise distances between 
Aq and any other sublattice point will always be smaller than 
the maximum pairwise distance between any two sublattice 
points not including Aq. This can be seen more clearly in 
Fig. |3] Notice that the distance between the pair of points 
labeled (Ai,A2) is twice the distance than that of the pair 
(Aq, Ai) or (Aq, A2). However by slightly increasing the region 
V to also include Aj other tuples may be made, which actually 
have a lower pairwise distance than the pair (Ai,A2). For 
this particular example, it is easy to see that the 3-tuple 
t = (Ao,Ai,A2) has a greater SPSD than the 3-tuple t' = 
(Aq, Ai, A2). 

For each Aq G (0) we center a region V around the point, 
and choose those A^ AT-tuples, that give the smallest SPSD. 
By expanding V new A'-tuples can be constructed that might 
have a lower SPSD than the SPSD of the original A^ AT-tuples. 
However, the distance from Aq to the points farthest away 
increases as V increases. Since we only need A^ A'-tuples, 
it can be seen that V should never be larger than twice the 
lower bound in (I24t because then the distance from the center 
to the boundary of the enlarged V region is greater than the 
maximum distance between any two points in the V region that 
reaches the lower bound. In order to theoretically describe the 
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' V 



Fig. 3. The region V is liere centered at the point Aq. Notice that the 
distance between Ai and A2 is about twice the maximum distance from Aq 
to any point in As nV. The dashed circle illustrates an enlargement of V. 



performance of the quantizers, we introduce a dimensionless 
expansion factor 1 < < 2 which describes how much 
V must be expanded from the theoretical lower bound i24\ . 
to make sure that N optimal ii'-tuples can be constructed by 
combining sublattice points within a region V. 

For the case of A' = 2 we always have ipj^ — 1 independent 
of the dimension L so it is only in the case K > 3 that we 
need to find expressions for ipL. 

Theorem 3.2: For the case of K = 3 and any odd L the 
dimensionless expansion factor is given by 

/ X 1/2L / r , 1 \ 1/2L 

V..-f^l (^) Pr"'\ (25) 



where ojl is the volume of an i-dimensional unit sphere and 
/3l is given by 



Pl 



2 

E 

n=0 



L+l 
2 



' L+l ' 
> 2 , 



■ 1-L \ 
, 2 > 



k=0 



{-ly 



k 

xE 

Proof: See Appendix ITTI 
For the interesting case of L 

theorem. 

Theorem 3.3: For A' = 3 and L 

expansion factor i/'l is given by 



1 



L + n + j 



(26) 



□ 



00 we have the following 



00 the dimensionless 



V'oo = 1 g 



1/4 



(27) 

□ 



3 and different values of 
ipoo = a/01- In order to 



Proof: See Appendix 11111 
Table IJ lists^ Vl for K = 
L and it may be noticed that 
extend these results to if > 3 it follows from the proof of 
Theorem 13.21 that we need closed-form expressions for the 
volumes of all the different convex regions that can be obtained 
by A' — 1 overlapping spheres. With such expressions it should 
be straightforward to find ipL for any AT. However, the analysis 

^Theorem l3.2l is only valid for L odd. However, in the proof of Theorem l3.2l 
it is straightforward to replace the volume of spherical caps by standard 
expressions for circle cuts in order to obtain 4'2 ■ 



L 




L 




1 


1.1547005 ■■ ■ 


15 


1.1036412- ■ ■ 


2 


1.1480804--- 


17 


1.1016878- ■■ 


3 


1.1346009 ■ ■ ■ 


19 


1.1000271 - ■ • 


5 


1.1240543 ■■ ■ 


21 


1.0985938--- 


7 


1.1172933 ■■ ■ 


51 


1.0883640--- 


9 


1.1124896 ■■ ■ 


71 


1.0855988--- 


11 


1.1088540--- 


101 


1.0831849--- 


13 


1.1059819 ■■■ 


00 


1.0745699... 



TABLE I 

VALUES OBTAINED BY USE OF THEOREMS |3.2I ANd )3.3I FOR K = 3. 



of 'ipL for the case of K = 3 (as given in the proof of 
Theorem 13. 2> is constructive in the sense that it reveals how 
tpL can be numerically estimated for any AT and L. Let i> 
denote the volume of the expanded sphere V. Furthermore, let 
us denote by T the number of AT-tuples that we construct by 
using lattice points inside this sphere. Hence, asymptotically 
as the number of lattice points in V goes to infinity we have 



T 



which leads to 



l/L 



(28) 



(29) 



where r denotes the radius of V and where without loss of 
generality we can assume that Vs ~ 1 (simply a matter of 
scaling). In order to numerically estimate ijjL it follows that 
we need to find the set of lattice points within a sphere V of 
radius r. For each of these lattice points we center another 
sphere of radius r and find the set of lattice points which 
are within the intersection of the two spheres. This procedure 
continues AT — 1 times. In the end we find T by adding the 
number of lattice points within each intersection, i.e. 

T = Y.Y.---Y. |A.nF(AK-2)n---nnAo)|, (30) 



where 

Ai - {Ai : Ai e A, n \/(Ao)}, 

A2 - {A2 : A2 e A, n \/(Ai) n l/(Ao)}, 



Aif_2 = {Ax-2 : Aif_2 e As n V{\k-?,) n 



ni^(Ao)}. 

(31) 



For example for AT = 4, A = and r = 10,20,50 and 
70 then using the algorithm outlined above we find 1^2 ~ 
1.1672, 1.1736, 1.1757 and 1.1762, respectively. 

Remark 3.1: In order to achieve the shift-invariance prop- 
erty of the index-assignment algorithm, we impose a restriction 
upon Ao points. Specifically, we require that Ao G V^(0) 
so that the first coordinate of any AT-tuple is within the 
region V^(0). To avoid excluding A'-tuples that have their first 
coordinate outside V-jri^) we form cosets of each A'-tuple and 
allow only one member from each coset to be assigned to a 
central lattice point within V^(0). This restriction, which is 
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only put on Aq e As , might cause a bias towards Aq points. 
However, it is easy to show that, asymptotically as ^ oo, 
any such bias can be removed. For the case of K — 2 v^s 
can use similar arguments as used in [14] and for K > 2 
we can show that the amount of X-tuples that is affected by 
this restriction is small compared to the amount of A'-tuples 
which are not affected. Hence, asymptotically as A^ ^ cx3, 
this restriction is effectively removed. So for example this 
means that we can enforce similar restriction on all sublattice 
points, which, asymptotically as, N ^ oo, will only reduce the 
number of AT-tuples by a neglectable amount. And as such, 
any possible bias towards the set of points Aq G As is removed. 

As mentioned above, the AT-tuples need to be assigned to 
central lattice points within Vir(O). This is a standard linear 
assignment problem where a cost measure is minimized. How- 
ever, solutions to linear assignment problems are generally 
not unique. Therefore, there might exist several labelings, 
which all yield the same cost, but exhibit a different amount 
of asymmetry. Theoretically, exact symmetry may then be 
obtained by e.g. time-sharing through a suitable mixing of 
labelings. In practice, however, any scheme would use a 
finite A^ (and finite rates). In addition, for many applications, 
time-sharing is inconvenient. In these non-asymptotical cases 
we cannot guarantee exact symmetry. To this end, we have 
provided a few examples that assess the distortions obtained 
from practical experiments, see Section [VTl (Tables HII and HIII i. 

IV. High-Resolution Analysis 

In this section we derive high-resolution approximations for 
the expected distortion. For this high-resolution analysis we 
let A'^ ^ oo and Vg — > 0. The effect of this is that the index 
of sublattice increases, but the actual volumes of the Voronoi 
cells shrink. 



A. Total Expected Distortion 

We first introduce Conjecture 14.11 which relates the sum of 
distances between pairs of sublattice points to G{Sl), the di- 
mensionless normalized second moment of an L-dimensional 
sphere. In Appendix II VI we prove the conjecture for the case 
of AT = 2 and any L as well as for the case of AT = 3 
and L cxd. In addition we show in Appendix IIVI that 
Conjecture 14. H is a good approximation for the case of AT = 3 
and finite L. After presenting Conjecture 14. ll we determine the 
dominating term in the expression for the expected distortion. 
This is given by Proposition 14.11 

Conjecture 4.1: For L, N ^ oo and 0, we have for 

any pair i, j = 0, . . . , AT - 1, i ^ j. 



||a,(A,)-a,-(A,)||2 =G(5,.)V'iA^2iV^^/^(^-iVV^ 
ind 2 
A _ J- V^"^ A 



Proposition 4.1: For N ^ oo and 2 < AT < oo we have 



O 



E 



Ae6V,(0) 



EAceV„(0) Ei=o Ej=i+l ll-^i ^jlP 

Proof: See Appendix IVl 



0. (32) 

□ 



The expected distortion ( I20> can by use of Theorem 13. II be 
written as 




K— 1 



K ^ 



i=t) 



K^k{K- 1) 




(33) 

By use of Conjecture l4.1l (as an approximation that becomes 
exact for L oo). Proposition 14.11 and Eq. M W it follows 
that ( I33t can be written as 

K 



K - K 



(0) 



K^k{K - 



K-2 A'-l 



H E E 

i=0 j=i+l 



X G(A,)i.^/^ + 



(34) 

The second term in ( I34> is the dominating term for k < K 
and N oo. Observe^ that this term is only dependent upon 
K through the coefficient ^,T"^ . 

The total expected distortion is obtained by summing over 
K including the cases where k = and k = K, 



da ~ A'lG(A,)i.2/i + A:2G(^L)^i7V2^/^(^-l)z.2/L 

+ p''E[\\X\\% 
where Ki is given by 



(35) 



K 



^1-E 



= i-p 



K 



K 



K-K, 



(36) 



and K2 is given by 



K 



(37) 



Using M6\ and \n\ we can write v and A^ as a function of 
differential entropy and side entropies, that is 

^ 22(Mx)-fl.c)^ (38) 

'This was pointed out by a reviewer who also drew the connection to recent 
results based on source-channel erasure codes [23] where the improvement 
by receiving more descriptions is almost linear in certain cases. 
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and 



(39) 



from which we may write the expected distortion as a function 
of entropies, that is 

(40) 

where we see that the distortion due to the side quantizers only 
depends upon the scaling (and dimension) of the sublattice and 
not which sublattice is used. 

B. Optimal v, N and K. 

We now derive expressions for the optimal v, N and K. 
Using these values we are able to construct the lattices Ac and 
As. The optimal index assignment is hereafter found by using 
the approach outlined in Section [111] These lattices combined 
with their index assignment completely specify an optimal 
entropy-constrained MD-LVQ system. 

In order for the entropies of the side descriptions to be equal 
to the target entropy Rt/K, we rewrite Ml\ and get 

Nv = 2^'-MX)~^^/K) A (41) 

where r is constant. The expected distortion may now be 
expressed as a function of v, 

da = i^lG(Ac)i/2/L 



(42) 



Differentiating w.r.t. v and equating to zero gives. 



dda _ 2 
diy L 
2 2 K 
L 



KiG{A, 



LK -1 



K2rLG{SL) 



.y L{K-\) J- L{K-1) ^ 



from which we obtain the optimal value of v 

( 1 k^ GjSL) 

'' = ^\T-ik;GiK7)'^') 

The optimal N follows easily by use of ( I41t 



HK-l) 
27? 



N =\{K -1) 



i^l G(Ae) 1 

^2 G{Sl) 



2K 



(43) 



(44) 



(45) 



Eq. (145 > shows that the optimal redundancy N is, for a fixed 
K, independent of the sublattice as well as the target entropy. 

For a fixed K the optimal and N are given by (I44> 
and (I45> . respectively, and the optimal K can then easily be 
found by evaluating (I35> for various values of K, and choosing 
the one that yields the lowest expected distortion. The optimal 
K is then given by 



K 



opt arg nun da, 



(46) 



where i^Tmax is a suitable chosen positive integer In practice K 
will always be finite and furthermore limited to a narrow range 
of integers, which makes the complexity of the minimization 
approach, given by (l46t . negligible. 



V. Construction of Quantizers 

In this section we design practical quantizers. We show that 
the index values are restricted to a discrete set of admissi- 
ble values. Knowledge of these values makes it possible to 
construct practical quantizers and theoretically describe their 
performance. 

A. Index Values 

Eqs. (I44t and ( I45> suggest that we are able to continuously 
trade-off central versus side-distortions by adjusting N and 
V according to the packet-loss probability. This is, however, 
not the case, since certain constraints must be imposed on 
N . First of all, since N denotes the number of central lattice 
points within each Voronoi cell of the sublattice, it must be 
integer and positive. Second, we require the sublattice to be 
geometrical similar to the central lattice. Finally, we require 
the sublattice to be a clean sublattice, so that no central 
lattice points are located on boundaries of Voronoi cells of 
the sublattice. This restrict the amount of admissible index 
values for a particular lattice to a discrete set, c.f. [14]. 

Fig. 13 shows the theoretically optimal index values (i.e. 
ignoring the fact that N belongs to a discrete set) for the 
A2 quantizer, given by (jjsj for iAl = 1, 1.1481 and 1.1762 
corresponding to K — 2,3 and 4, respectively. Also shown 
are the theoretical optimal index values when restricted to 
admissible index values. Notice that the optimal index value N 
increases for increasing number of descriptions. This is to be 
expected since a higher index value leads to less redundancy; 
this redundancy reduction, however, is balanced out by the 
redundancy increase resulting from the added number of 
descriptions. In [50] we observed that for a two-description 

Index values for the quantizer: N={1 ,7,1 3,19,31 ,37,43,49) 



K=2: Theoretical N 

K=3: Theoretical N 

K=4: Theoretical N 

Admissible N 




40 60 
Packet loss probability [%] 



80 



100 



Fig. 4. Theoretical optimal index values for the A2 quantizer as a function 
of packet-loss probability. Thin sohd lin es a re obtained by restricting the 
theoretical optimal index values given by <451 to optimal ad miss ible values. 
The optimal admissible index values are those that minimize <35l for a given 



system, usually only very few index values would be used. In 
fact for the two-dimensional A2 quantizer, only e {1,7, 13} 
should be used. Higher dimensional quantizers would use 
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greater index values. However, here we see that by increasing 
the number of descriptions beyond K — 2, it is optimal to 
use greater index values which adds more flexibility to the 
scheme. 

From Fig.^it can be seen that when the continuous optimal 
index value is rounded to the optimal admissible index value 
it is always the closest one from either below or above. This 
means that the optimal admissible index value is found by 
considering only the two values closest to the continuous index 
value, and using the one that minimizes ( I35> . 

VI. Numerical Evaluation 

In this section we compare the numerical performances 
of two-dimensional entropy-constrained MD-LVQ systems 
(based on the A2 lattice) to their theoretical prescribed perfor- 
mances. 

A. Performance of Individual Descriptions 

In the first experiment we design a 3-channel MD-LVQ 
based on the A2 quantizer We quantize an i.i.d. unit-variance 
zero-mean Gaussian source which has been blocked into 
two-dimensional vectors. The number of vectors used in the 
experiment is 2 • 10^. The entropy of each side description 
is 5 bit/dim. and we vary the index value in the range 31 - 
67. The dimensionless expansion factor ijjL is set to 1.14808. 
The numerical and theoretical distortions when receiving only 
a single description out of the three is shown in Table Ull 
Similarly, Table Hill shows the distortions of the same system 
due to reception of two out of three descriptions and Table II Vl 
shows the performance of the central quantizer when all 
three descriptions are received. The column labeled "Avg." 
illustrates the average distortion of the three numerically 
measured distortions and the column labeled "Theo." describes 
the theoretical distortions given by \2>A\ It is clear from the 
tables that the system is symmetric; the achieved distortion de- 
pends on the number of received descriptions but is essentially 
independent of which descriptions are used for reconstruction. 



N 


Ao 


Ai 


A2 


Avg. 


Theo. 


31 


-25.6918 


-25.6875 


-25.6395 


-25.6729 


-24.8280 


37 


-24.5835 


-24.5324 


-24.5404 


-24.5521 


-24.4571 


43 


-24.5772 


-24.5972 


-24.5196 


-24.5647 


-24.1396 


49 


-24.2007 


-24.2837 


-24.2713 


-24.2519 


-23.8622 


61 


-23.8616 


-23.9011 


-23.8643 


-23.8757 


-23.3946 


67 


-23.7368 


-23.7362 


-23.7655 


-23.7462 


-23.1936 



TABLE II 

DISTORTION [DB] due TO RECEPTION OF A SINGLE DESCRIPTION OUT OF 

THREE. 



B. Distortion as a Function of Packet-Loss Probability 

We now show the expected distortion as a function of 
the packet-loss probability for A'-channel MD-LVQ systems 

'"since we do not consider packet-losses in this experiment we have set 
the weight to unity, i.e. (1 — p)'^P^^^ = 1- 



N ^(Aq-HAi) 1(Ao + A2) ^(Ai+Aa) Avg. Theo. 



31 


-30.7792 


-30.7090 


-30.7123 


-30.7335 


-30.6810 


37 


-29.8648 


-29.8430 


-29.9472 


-29.8850 


-30.3482 


43 


-29.9087 


-29.8749 


-29.9641 


-29.9159 


-30.0563 


49 


-29.6290 


-29.5577 


-29.6662 


-29.6176 


-29.7971 


61 


-29.3076 


-29.2185 


-29.3715 


-29.2992 


-29.3532 


67 


-29.1752 


-29.2128 


-29.2151 


-29.2010 


-29.1603 



TABLE III 

Distortion [dB] due to reception of two descriptions out of 





THREE. 




N 


Ac 


Theo. 


31 


-43.6509 


-43.6508 


37 


-44.4199 


-44.4192 


43 


-45.0705 


-45.0719 


49 


-45.6401 


-45.6391 


61 


-46.5879 


-46.5905 


67 


-46.9992 


-46.9979 



TABLE IV 

Distortion [dB] due to reception of all three descriptions out 
OF three. 



where K = 1,2,3. We block the i.i.d. unit- variance Gaussian 
source into 2-10^ two-dimensional vectors and let the total 
target entropy be 6 bit/dim. The expansion factor is set to 
^^2 = 1 for K =1,2 and V2 = 1.14808 for = 3. We 
sweep the packet-loss probability p in the range p £ [0; 1] in 
steps of 1/200 and for each p we measure the distortion for all 
admissible index values and use that index value which gives 
the lowest distortion. This gives rise to an operational lower 
hull (OLH) for each quantizer. This is done for the theoretical 
curves as well by inserting admissible index values in ( I35t and 
use that index value that gives the lowest distortion. In other 
words we compare the numerical OLH with the theoretical 
OLH and not the "true"" lower hull that would be obtained 
by using the unrestricted index values given by \A5\ . The target 
entropy is evenly distributed over K descriptions. For example, 
for K ~ 2 each description uses 3 bit/dim., whereas for 
K = i each description uses only 2 bit/dim. The performance 
is shown shown in Fig. [S] The practical performance of the 
scheme is described by the lower hull of the /^-curves. Notice 
that at higher packet-loss probabilities (p > 5%) it becomes 
advantageous to use three descriptions instead two. 

VII. Conclusion and Discussion 

In this work we derived analytical expressions for the central 
and side quantizers which, under high-resolutions assump- 
tions, minimize the expected distortion of a symmetric n- 
channel MD-LVQ subject to entropy constraints on the side 
descriptions for given packet-loss probabilities. The expected 
distortion observed at the receiving side depends only upon 
the number of received descriptions but is independent of 
which descriptions are received. We focused on a special case 

"a lattice is restricted to a set of admissible index values. This set is 
generally expanded when the lattice is used as a product quan tizer , hence 
admissible index values closer to the optimal values given by |45l can in 
theory be obtained. 
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A quantizer 




40 60 
Packet loss probability [%] 



Fig. 5. Distoilion as a function of packet-loss probability for the A2 
quantizer. The target entropy is 6 bit/dim., so each description gets 6/K 
bit/dim. Thick lines show numerical performance and thin solid lines show 
theoretical performance. 

of the symmetric multiple-description problem where only a 
single parameter controls the redundancy tradeoffs between the 
central and the side distortions. As such more work is needed 
before the general symmetric ?i-channel MD-LVQ problem is 
completely solved. A step in that direction is presented in [34]. 

Future work in progress includes extending the presented 
scheme to the asymmetric case, where packet-loss probabil- 
ities, entropies and distortions may differ for the different 
descriptions [55]. 

Appendix I 
Proof of Theorem I3.1I 

In order to prove Theorem 13.11 we need the following 
results. 

Lemma 1.1: For 1 < k < X we have 



K-l 



/ K-l \ 

\ J ■ 

lac \ ]=Q I V -/ \ / 

Proof: Expanding all sums on the left-hand-side leads 
to (^)k different terms of the form {Xc,Xi), where i E 
{0, . . . ,K — 1}. There are K distinct A^'s so the number of 
times each Ai occur is (J^)k/K. □ 
Lemma 1.2: For 1 < k < X we have 



E 

lec 3=0 



K (K 



K-l 

Eii^^ 

i=0 



2k{k- 1) fK 



K~-2 K-l 



Proof: There are (^) distinct ways of adding k out of 
K elements. Squaring a sum of k elements leads to k squared 
elements and 2(2) cross products (product of two different 
elements). This gives a total of (^)k squared elements, and 
2(^)(2) cross products. Now since there are K distinct 
elements, the number of times each squared element occurs is 
given by 

(f)^. (47) 



There are (^) distinct cross products, so the number of times 
each cross product occurs is given by 



n _ fKyit) _ 2k{k-1) fK 

Lemma 1.3: For i^T > 1 we have 

K-l K-2 K-l 

i=0 1=0 j=i+l 

K-2 K-l 



(48) 

□ 



(49) 



= E E 11^^-^. 



i=0 j=i+l 

Proof: Expanding the right-hand-side of J49> yields 

K-2 K-l 

E Eii^^-^.ii' 

(50) 

K-2 K-l ^ ' 

= E E (llA.|P + |lA,f -2(A„A,)). 

i=0 j=i+l 

We also have 

EE m' + u^r) 

i=0 j=i+l 

K-2 K-2 K-l 

1=0 1=0 j=i+l 

K-2 K-l 

i=0 j = l 

K-l K-l 
= 5](i^-l-*)||A,;|l2+5]j-||A,||2 
i=0 j=0 

= YiK~mx,f-YMM' + IlM:\ 



(51) 



2=0 



i=0 



K-l 



(if- 1)^11 A 



2 

«ii I 



i=0 



which completes the proof. □ 
We are now in a position to prove the following result. 
Proposition 1.1: For 1 < k < K we have 



E 



3=0 

K- K 



Proof: We have 



^ \ 4=0 

s K-2 K-l \ 

lyjE E IIA.-A.I1O. 



lAc|p-2^A.,i£A, 

K-l 



3=0 
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Hence, by use of Lemmas 11.11 and 11.21 we have that 



E 




K-1 



2(k- 1) 
K{K 

K 



K-l 

|AelP-|(A.EA.^ + ^El|A. 

' i=0 i=i+l / 



A'-l 



i=0 



1 
X2 



1 = ^ ' 1=0 7 = 1+1 



K-l 

Ea. 

i=0 
A'-2 A-1 




K-l 



K-l 



1=0 



K-2 K-l 



+ (if/^-i)«;"if^j E E(A.,A, 

^ ^ ^ ^ i=0 i=i+l 



K ~K 



^ \ i=0 

„ s A-2 A-1 \ 

^ 1=0 j = i+l / 



K-l 

Eii^^ 

i=0 



SO that, by Lemma [T31 we finally have that 

K-l 2 




is:- K 



i=0 
K-2 K-l 



ly E E IIA.-^. 



K^k(K - 1), 

^ ^ ^ i=0 j=i+l 

which completes the proof. 
Theorem \3.1\ For 1 < k < X we have 

2 



□ 



EE 



K-l 



Ac 



3=0 




K-l 



-Ea 

K ^ 



i=0 



K - K 



K-2 K-l 



ly E E IIA^-A. 



\ ' ^ i=0 j=i+l 

Proof: Follows trivially from Proposition ll.il 

Appendix II 
Proof of TheoremI3.2I 



□ 



Theorem 13.21 For the case of i^T = 3 and any odd L the 
dimensionless expansion factor is given by 

/ X 1/2L / r I 1 \ l/2i 

(52) 



2L 



where fi^ is given by 



n=0 ^ ^ fc=0 \ 2 )k 



tL+l\ ( i-L \ 

2 Jk\ 2 )k 



(53) 



J=o 



J J V2 



(-IF 



1 



4 / L + n + j 



Proof: In the following we consider the case of X = 3. 
For a specific Aq G we need to construct N 3-tuples all 
having Aq as the first coordinate. To do this we first center 
a sphere V of radius r at Aq. For large N and small this 
sphere contains approximately iy/iyg lattice points from Ag. 
Hence, it is possible to construct (vjvsY distinct 3-tuples. 
However, the maximum distance between Ai and A2 points is 
greater than the maximum distance between Ao and Ai points 
and also between Aq and A2 points. To avoid this bias towards 
Ao points we make sure that we only use 3-tuples that satisfy 
II Ai — Ajll < r/\fL for i,j = 0,1,2. However, with this 
restriction we can no longer form N 3-tuples. Therefore, we 
expand V by the factor V'l in order to make sure that exactly 
N 3-tuples can be made. It is well known that the number 
of lattice points at exactly squared distance / from c, for any 
c e is given by the coefficients of the Theta series of 
the lattice A [37]. Theta series depend on the lattices and 
also on c [37]. Instead of working directly with Theta series 
we will, in order to be lattice and displacement independent, 
consider the i-dimensional hollow sphere C obtained as C = 
S{c, m) — S{c, TO — 1) and shown in Fig. |6ja). The number of 
lattice points a„i in C is given by \C D A| and asymptotically 
as ^ (and independent of c) 



Vol(C)/i/, 



(to^ - (m- 1)^). 



(54) 



The following construction makes sure that we have ||Ai — 
A2II < r/^/L. For a specific Ai € V^(Ao) fl Ag we center a 
sphere V at Ai and use only A2 points from V'(Ao) O y(Ai) fl 
As- In Fig.|6jb) we have shown two overlapping spheres where 
the first one is centered at some Ao and the second one is 
centered at some Ai G V^(Ao) which is at distance to from 
Ao, i.e. II Ao — Ai|| = m/^/L. Let us by C denote the convex 
region obtained as the intersection of the two spheres, i.e. 
C — F(Ao)ny(Ai). Now let bm denote the number of lattice 
points in Cn As. With this we have, asymptotically as I's ~^ 0, 
that bjn is given by 



yoi{c)/vs 



(55) 



It follows that the number T of distinct 3-tuples which 
satisfy ||Ai — Aj|| < r/VX is given by 



Km T = ambm- 

771 = 1 



(56) 



The region C consists of two equally sized spherical caps. 
We can show that the volume of an L-dimensional {L odd) 
spherical cap T^ap is given by (we omit the proof because of 
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(a) 



(b) 



Fig. 6. The number of lattice points in the shaded region in (a) given by 
= Vol(C)/j/s and in (b) it is given by bm = 'Vol{C)/us. 



space considerations) 



X 2^1 



L + l 1-L L + 3 2r -m 



2 ' 2 2 ' 4r 



(57) 



where the Hypergeometric function 2-^i( ) is defined by [51] 



T I u \ \^ {a)k{b)k k 
2^i(a,6,c,z) = X:^-^z, 



where {■)k is the Pochhammer symbol defined as 



(58) 



as Vs 0) 

r 



2uJl^L-1 ST^ / L / T\L\ (L-l)/2 

———^{m -(m~l) y ^1 



X (2r - m)(^+i)/22^i 



i + 1 1-L L + 3 2r-m 



2 ' 2 



4r 



(a) 2a;LU;L_i ^ /i+l 

n=0 



■L-l 
2 



2 l(2r) 



2 /fc V 2 /fc 



fc=0 



(-1)^- 



4r 



^ (to-^ - (to - l)-^)TO"r 



m— 1 



(b) 2a;L'^L-i iiizi 
— -r 2 



n=0 



fc=0 2 jfe 



k~3 



-L + l 
2 

E 



-r 2 



4r 



L 



L + n + j 



Or 



L-l+n+j^ 



(60) 



where (a) follows by use of the binomial series expansion [52, 
p. 162], i.e. (a; + y)'' = J2n=o O^'^'^'v"^ which in our case 
leads to 



I 1 fc = 

~ |a(a + l)---(a + fc-l) fc > 1. ^^^^ 



If either of a and b or both are negative, the sum in (I58> 
terminates. 

Inserting (I54> and J55> into ( I56t leads to'^ (asymptotically 



'^We remark that in this asymptotical analysis we assume that all Ai points 
within a given C is at exact same distance from the center of V (i.e. from 
Ao). The error due to this assumption is neglectable, since any constant offset 
from m will appear inside 0{-). 



2 / L + l 



(2r-TO)^ = ^ 2 (2r)^— "(-1)"to" (61) 



and 



2r — TO 
4r 



E 

3=0 



JJ \2 



(&) is obtained by once again applying the binomial series 
expansion, that is 



(m- 1)^ = - Lto^^i +C'(to'^"'^), (63) 



L-2\ 



and (c) follows from the fact that J2m=i ' 
Next we let r 



_!_„L + 1 

L + l' 



oo so that the number of hollow 
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spheres inside V goes to infinity From j60> we see that, 
asymptotically as j/^ and r — > cx), we have 



T = 2- 



L + 1 



(65) 



where is constant for fixed L and given by (I53> . 

We are now in a position to find an expression for ip^. Let 
P be equal to the lower bound (I24> . i.e. 9 — Vs\/N and let 
f be the radius of the sphere having volume v. Then V'l is 
given by the ratio of r and f, i.e. t/^i = r/r, where r is the 
radius of V . Using this in ( I65> leads to 



(66) 



Tv,{L + l) \^'^^ 



Since the radius r of an L-dimensional sphere of volume i> is 
given by 

we can find ipi^ by dividing ( I66> by ( I67> . that is 



1/2L / - \ -1/L 



(68) 



Since we need to obtain N 3-tuples we let T = iV so that 
with D — ^/N we can rewrite ( I68> as 



( 



1/2L 



\UJL-1, 

This completes the proof. 



L + 1 
2L 



1/2L 



Pi 



-1/2L 



(69) 

□ 



Appendix III 
Proof of TheoremI3.3I 



Lemma 3.1: For L ^ cx3 we have 

1/2L 



WL-1 



= 1. 



(70) 



Proof: The volume ujl of an i-dimensional unit hyper- 
sphere is given by ujl = 7r^/^/(L/2)! so we have that 



lim 



/ 7r^/2 (L/2- 1/2)! 



1/2L 



L^oo\[L/2)\ 7r^/2-i/2 

= lim 7ri/4^(0(L-i))'/''' 

= 1. 

Lemma 3.2: For L — > oo we have 

1/4 



^1/2L 



(71) 

□ 

(72) 



'^We would like to emphasize that this is equivalent to keeping r fixed, 
say r = 1, and then let the number of holl ow spheres inside V go to infinity. 
To see this let M — > oo and then rewrite 1541 as 



O-m/M = Vol(C)/!^s 



'^L I f f m — 1 



■ Mj 



M 



l<m< M. 



(64) 



A similar change applies to \55\ . Hence, the asymptotical expression for T 
is also valid within a localized region of which is a useful property we 
exploit when proving Lemma |4!T1 



Proof: The inner sum in ( I26> may be well approximated 
by using that -^-i^ « ^ for i 3> c, which leads to 



E 

3=0 



31 V2 



(-i)M7'' 



4 / L + n + j 



J=0 

-(- 

L V4 



n-' 1 



4/ L 



(73) 



We also have that 

L-l 



■ L+l \ ( l-L \ 
. 2 )k\ 2 )k 



T I =2^1 



k=a \ 2 )k ^- ^ 

^=^l-l/4)(-i+^)^^i(l, 



L + 1 1-L L + 3 1 



2 ' 2 ' 2 ' 4 
1 - L L + 3 1 



L/2-1/2 



^ (3/4)(-i+L)/2 ^ 



fc=0 



fc! {l/2-L/2)k 
k\ (3/2 + L/2)fc 



(-1/3)^ 



= (3/4)(-i+^)/2 

L/2-1/2 

X 

fe=0 

L/2-1/2 

« (3/4)(-i+L)/2 ^ (i/3)fc 

fc=0 



(74) 



where (a) follows from the following Hypergeometric trans 
formation [51] 

2^1 (a, b; c; z) = (1 - 2;)"''2J^i (c - a, b; c; , 



where ^ = ^^j. Finally, it is true that 

L/2+1/2 

E 



L/2 + l/2\ 2L/2+l/2-nj-_2^n ^ 

n J 



Inserting J73> . ( I74> and ( I76> into ( I53> leads to 

L/2-1/2 



/3l 



(3/4)(-i+L)/2^ ^ (l/3)^ 



(75) 



(76) 



(77) 



fe=0 



where since J2T=o(^/'^)'' ~ 'il'2, we get 



lini -1- = lim (4/3)i/4(4/3)-i/4L^i/2L(2/3)i/2L 



L — >oo 



/3. 



(4/3)l/^ 



(78) 



which proves the Lemma. □ 
We are now in a position to prove the following theorem. 
Theorem 13.31 For A' = 3 and L ^ oo the dimensionless 
expansion factor ■0L is given by 



■0O 



1/4 



(79) 



Proof: The proof follows trivially by use of Lemma ITT] 
and Lemma l3T2l in ( I69> . □ 
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Appendix IV 
Conjecture 14. II 

In this appendix we justify Conjecture 14.11 by proving it 
for the case of i^T = 2 and any L as well as for the case of 
K — "i and L ^ oo. In addition we show that it is a good 
approximation for the case of K = i and finite L. 

Let Ti, ^ {Ai : = aj(Ac), Ac G K-(O)}, i.e. the set of 
N"^ sublattice points Ai e associated with the N'^ central 
lattice points within Vt^{Q). Furthermore, let T/ C Ti be the 
set of unique elements of Ti, where |T/| w N. Finally, let 
TAX^) = {Aj : \j = aj(Ac) and A, = a,(Ac), Ac G ^.(0)} 
and let T'^{\j) C Tj{Xi) be the set of unique elements. That 
is, Tj{Xi) contains all the elements Xj e A^ which are in the 
i^-tuples that also contains a specific Ai. We will also make 
use of the notation #a to indicate the number of occurrences 
of a specific Xj in Tj{Xi). 

For the pair we have 



|a,(Ac)-a,(Ac)|p 



E E iiA^ 

A,GT/ Aj6Tj(A,) 



Given A^ G T/, we have 



j2 \\^^-x,r^s = 



A,eT,(A,) A,GT'(A,) 



(a) N_ 
N 



A,GT,'(A,) 

TV /• 2 . (80) 



TV 



V(A.) 



II Ai — a;|| dx 



(b) 



N 



where (a) follows by assuming (see the discussion below 
leading to Lemma EJ) that = N/N for all Aj G Tj{Xi) 
and (&) follows since v = TVi^s- Hence, with v = Nvg = 

ipN^/'^^~'^)i/^ and i/^ = Nv, we have 



A,GT,(A.) 



||A,; - X,fv, « A^i.,^ii.2/L^2/L^2/L(K-l)g(^^) 



which is independent of A;, so that 



E E ii^'^ 

AiET/ AjeT, (A,) 



TV 



E 

A,GT,(A.) 



I|A»-A,|| 



^2^2+2K/L(if-l)^2/L^(^^)_ 



In ( I80> we used the approximation k, N/N without any 
explanation. For the case of K — 2 and as ^ oo we have 
that T/ = Ti and N = N, hence the approximation becomes 
exact, i.e. = 1. For AT = 3 we have the following Lemma. 

Lemma 4.1: For K ~ 3 and asymptotically as L ^ oo the 
following approximation becomes exact. 



E 

A, ST, (A.) 



||A,-A,||2«Ari>2/iG(5L). 



(81) 



Proof: Using the same procedure as when deriving 
closed-form expressions for ip^ leads to the following asymp- 
totical expression 

1 

E 11^'- - ^^11' = 7 E (82) 



A, ST, (A,) 



where we without loss of generality assumed that A^ ~ and 
used the fact that we can replace ||Aj||^ by w? /L for the Xj 
points which are at distance m from Ai — 0. It follows that 
we have 



E llA.-A,lp-2 

A,eT,(A,) 



^^^r^P'Lr''^\ (83) 
vi L + l 



where 



2 J k \ 2 J k 



1 



(84) 



Since i> uj^r^ = ^j^\/Nvs we can rewrite j83> as 



E l|A.-A,ir = 2 

A,eT,(A,) 



UJLUJL~l 1 „, -2+2/ L 1 
iy2 L + l'^ ,,2+2/i 



= 2 



1+2/LX + l 



(a) ^ iVL-l 1 pf^~2/Lj^( \ f L + 1\ 1 

1 1~.2/l../3l 



ujL-iJ \ 2L J f3L 



where (a) follows by inserting ( I69l l. Dividing i&5\ by (E 
leads to 



(85) 



1 1 



1 P'r L + 2P' 



L (3l 



Hence, asymptotically as L ^ oo we have that 



lim 



L + 2/3i 



1, 



(86) 



(87) 



which proves the lemma. □ 
For A' > 3 it is very likely that similar equations can be 
found for V'l which can then be used to verify the goodness 
of the approximations for any K. Moreover, in Appendix fVl 
we show that the rate of growth of ( I80> is unaffected if we 
replace by either miiiAj{#Aj or maxA^{#Aj which 
means that the error by using the approximation N/ N instead 
of the true is constant (i.e. it does not depend on A^) 
for fixed K and L. It remains to be shown whether this error 
term tends to zero as L oo for AT > 3. However, based on 
the discussion above we conjecture that, for any AT, the side 
distortions can be expressed through the normalized second 
moment of a sphere as the dimension goes to infinity. 
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Conjecture [4.1\ For N, L ^ oo and i^s — > 0, we have for any 
pair {i, j), i, j ^ 0, . . . , K - 1, j, 

Ac e 14(0) 

Appendix V 
Proof of Proposition I4.1I 



Before proving Proposition 14. II we need to lower and upper 
bound (see Appendix IIVI for an introduction to this 

notation). As previously mentioned the Xj points which are 
close (in Euclidean sense) to A; occur more frequently than Xj 
points farther away. To see this observe that the construction 
of i^-tuples can be seen as an iterative procedure that first 
picks a Aq G As n V^7r(0) and then any Ai e As is picked such 
that II Ao - Aill < r/^/T, hence Ai G As n ^(Ao). The set 
of Xk-1 points that can be picked for a particular {K — 1)- 
tuple e.g. (Ao, . . . , A^ -2) is then given by {Xk-i ■ Xk-i e 
As n V{Xk-2) n • • • n V'(Ao)}. it is clear that ||Aj - Xj\\ < 
r/VL where {Xi,Xj) ~ (ai(Ac), aj(Ac)), VAc e Ac and any 

i,je {o,...,if-i}. 

Let Tinin(Ai, Xj) denote the minimum number of times the 
pair (Ai, Xj) is used. The minimum Tmin of Tinin(Ai, A^) over 
all pairs (A^, Xj) lower bounds N/N . We will now show that 
Tmin is always bounded away from zero. To see this notice that 
the minimum overlap between two spheres of radius r centered 
at Aq and Ai, respectively, is obtained when Aq and Ai are are 
maximally separated, i.e. when ||Ao — Ai|| = r/^/L. This is 
shown by the shaded area in Fig.0for L = 2. For three spheres 
the minimum overlap is again obtained when aU pairwise 
distances are maximized, i.e. when ||Ai — Aj|| = rl\fL for 

j e {0, 1,2} and i ^ j. It is clear that the volume of the 




Fig. 7. Three spheres of equal radius are here centered at the set of points 
s = {Ao, Ai, A2}. The shaded area describes the intersection of two spheres. 
The equilateral triangle describes the convex hull C{s) of s. 



intersection of three spheres is less than that of two spheres, 
hence the minimum number of A2 points is greater than the 
minimum number of A3 points. However, by construction it 
follows that when centering K spheres at the set of points 
s = {Ao, . . . , Aa'-i} = {ao(Ac), . . . ,aA'-i(Ac)} each of the 
points in s will be in the intersection Hs of the K spheres. 
Since the intersection of an arbitrary collection of convex sets 
leads to a convex set [53], the convex hull C{s) of s will 
also be in Hs. Furthermore, for the example in Fig. it can 



be seen that C(s) (indicated by the equilateral triangle) will 
not get smaller for K > "i and this is true in general since 
points are never removed from s as K grows. For L = 3 
the regular tetrahedron [40] consisting of four points with a 
pairwise distance of r describes a regular convex polytope 
which lies in Hs. In general the regular L-simplex [40] lies 
in Hs and the volume V{L) of a regular L-simplex with side 
length r is given by [54] 

ni)-^^\/^-c,r^ (88) 



where depends only on L. It follows that the minimum 
number of A'-tuples that contains a specific [Xi.Xj) pair is 
lower bounded by V [LY'^ ^"^ / ^"^ . Since the volume vofV 
is given by v ~ uolt'" we get 

K-2 



f V{L) 



K-2 



K-2 



(89) 



Also — by construction we have that N < {v/vg)^ ^ and 
that iV = i>/j/s so an upper bound on N / N is given by 

A'-2 

(90) 



N 

^ < 
N ~ 



which differs from the lower bound in ( I89> by a multiplicative 
constant. 

We are now in a position to prove Proposition 14. II 
Proposition [4.1\ For N ^ 00 and 2 < K < 00 we have 



o 



Xr 



j_ A-1 . 



E 



^K~2y^K-1 II , 



0. (91) 



Proof: The nominator describes the distance from a 
central lattice point to the mean vector of its associated K- 
tuple. This distance is upper bounded by the covering radius 
of the sublattice Ag. The rate of growth of the covering radius 
is proportional to vl^^ — {Nv)^/'", hence 



E 

Acey^(o) 



K-l 



1 ^ A, (Ar2^2/L^2/L^ 



(92) 



(93) 



Since the approximation N / N used in Conjecture 14.11 is 
sandwiched between the lower and upper bounds (i.e. Eqs. 
and \9QV ) we can write 

E E E ll«.(Ac)-a,(Ae)f 

AceVV(O) i=0 j=i+l 
K-2 K-1 

= E E E ll«.(Ac)-a,(A.)f 

« iA-(i^- l)G(5L)^i7V2iV2K/L(K-l)^2/L^ 

SO that, since A; — ai(Ac), 

E E E 11^' - ^^n' = ^ (a^2^2k/l(k-i)^2/l> 

AeGV;r(0) i=0 j=i+l 

(94) 
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Comparing j92t to we see that j9U grows as 

O (Ar-A7(A'-i)-) ^ for TV -> cx) and < oo. □ 
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